Learning sub-patterns in piecewise continuous functions

نویسندگان

چکیده

Most stochastic gradient descent algorithms can optimize neural networks that are sub-differentiable in their parameters; however, this implies the network’s activation function must exhibit a degree of continuity which limits network model’s uniform approximation capacity to continuous functions. This paper focuses on case where discontinuities arise from distinct sub-patterns, each defined different parts input space. We propose new discontinuous deep model trainable via decoupled two-step procedure avoids passing updates through only and strategically placed, unit. provide guarantees for our architecture space bounded functions universal piecewise we introduced herein. present novel semi-supervised training learning model, tailored its structure, theoretical support effectiveness. The performance trained with is evaluated experimentally both real-world financial datasets synthetic datasets.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fitting piecewise linear continuous functions

We consider the problem of fitting a continuous piecewise linear function to a finite set of data points, modeled as a mathematical program with convex objective. We review some fitting problems that can be modeled as convex programs, and then introduce mixed-binary generalizations that allow variability in the regions defining the best-fit function’s domain. We also study the additional constr...

متن کامل

Continuity of super- and sub-additive transformations of continuous functions

We prove a continuity inheritance property for super- and sub-additive transformations of non-negative continuous multivariate functions defined on the domain of all non-negative points and vanishing at the origin. As a corollary of this result we obtain that super- and sub-additive transformations of continuous aggregation functions are again continuous aggregation functions.

متن کامل

Convex Underestimation of C2 Continuous Functions by Piecewise Quadratic Perturbation

Clifford A. Meyer and Christodoulos A. Floudas Department of Chemical Engineering, Princeton University, Princeton, NJ 08544, USA Abstract This paper presents an efficient branch and bound approach to address the global optimization of constrained optimization problems with twice differentiable functions. A lower bound on the global minimum is determined via a convex nonlinear programming probl...

متن کامل

Irredundant lattice representations of continuous piecewise affine functions

In this paper, we revisit the lattice representation of continuous piecewise affine (PWA) function and give a formal proof of its representation ability. Based on this, we derive the irredundant lattice PWA representation through removal of redundant terms and literals. Necessary and sufficient conditions for irredundancy are proposed. Besides, we explain how to remove terms and literals in ord...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2022

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2022.01.036